Figure 1 

AUS9-2000-0546-US1 



m 




Modem Serial Ports 



Sheet 1/11 



□ 

'A 

'-■4 
W 



Consumer 
202 



Host Processor Node 




Consumer 
204 




Consumer 
206 



000 



Consumer 
208 



PCI/PCI-X Device 
Driver 
230 




Message & Data Service 
224 



Verbs — 



Channel Adapter (end node) 
210 



Port 
214 



OOP 



Port 
216 



200 L 



Channel Adapter (endnode) 
212 



Port 


00 


Port 




218 




220 



CO 



ru 
□ 

Q 

<Z=4 



Figure 2 

AUS9-2000-0546-US1 



Sheet 2/11 



• 




318,. 



322 32 /ra nsport ^ 32 s^ 



ooo 



Port 
312 



OOO 



Port 
314 



330 

OOO 



Channel Adapter 



MTP 



336 
8 



OOO 



Port 
316 



Figure 3 



■m 

j>4 AUS9-2000-0546-US1 



ru 
a 

V! 



a 



Sheet 3/11 



Figure 4 

AUS9-2000-0546-US1 



•id 



ru 

□ 



4U 






Data 
4 Segment 1 

AAA 

444 




a Data 
Segment 4 
/ 438 








/ 




.* Data 
Segment 2 
446 


/ 

/ 

/ 


/ 

. Data 

oegment 5 

/ / 440 






/ 

/ i 
/ / 

/ / 

/ / 

'/ ' 


/ 

* 


/ / 

/ 


Data 
Segment 3 
448 


- Data 
Segment 6 
/ 442 


: / / 

i : / 
i i / 







J Receive Work Queue 400 j j 



WQE 

418 



WQE 

419 



402 Send Work Queue f 



WQE 

424 



WQE 

426 



Completion Queue 404 



E CQE CQE i CQE i 
430 432 434 ^ 




408 



436 



Sheet 4/1 1 



Figure 5 

AUS9-2000-0546-US1 



Q 

'-■4 

!«i 



Message data 
500 



Data Segment 1 
502 

A_ 



T 



Data Segment 2 
504 

A 



T 



Data Segment 3 
506 
A 



Packet 508 



■Routing 
i Header 
^516 



Transport 
Header 
518 



Packet Payload 
510 



CRC 

514 



(Bata Packet (Routed unit of work) 



512 



J 



Sheet 5/1 1 



Figure 6 

AUS9-2000-0546-US1 




Sheet 6/11 



• 



Figure 7 

AUS9-2000-O546-US1 




Sheet 7/1 1 



^ Begin ^ 



Processor issues a store to an IOA. 
802 



HCA sees the store and compares the address to the range of addresses on the 
PCI buses known to the HCA. 
804 




-NO- 



Ignore the store operation. 
818 



HCA places the address and data from the store instruction along with the store 
command into the data payload of an IB packet. 
808 



Based on the address decoded, the HCA determines which TCA contains the 
PCI address range and puts the LID address of the TCA into the packet header, 
creates the CRC, etc., and places the packet on the IB fabric, 

810 



Route the packet to the correct TCA. 
812 



The TCA recognizes and accepts the packet. 
814 



The TCA decodes the packet payload and creates a write operation on the PCI 
bus with the given data and address. 
816 

c EM > 

Figure 8 

AUS9-2000-054S-US1 

Sheet 8/11 



Processor issues a load to an tOA. 
902 



Figure 9 

AUS9-200OO546-US1 



HCA sees the load and compares the address to the range of addresses on the PCI buses known to the HCA. 

904 




Ignore toad. 
926 



HCA places the address from the load instruction along with the load command into the data payload of an IB packet. 

908 



Based on the address, the HCA determines which TCA contains the PCI address range I 
and places the LID address of the TCA into the packet header, creates the CRC, etc,, 
and places the packet on the IB fabric. 
910 



The packet is rerouted to the correct TCA where the TCA recognizes the packet and accepts the packet. 

912 



The TCA decodes the packet data payload and creates a read operation on the PCI bus with the given data and address. 

914 



The TCA waits for the data from the PCI-X IOA. 
916 



The TCA places the requested data and the load reply command into the data payload of an IB packet. 
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10A issues a DMA write to the PCI bus. 
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The packet is routed to the correct HCA where the HCA recognizes and 
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The HCA decodes the packet and determines that that is is a PCI operation 
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The HCA further decodes the packet payload and creates a write operation to 
the system memory with the given data and address. 
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The TCA places the LID address of the HCA which will handle the access to 
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The HCA further decodes the packet payload and creates a read operation to 
system memory with the given data and address. 
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The HCA places the requested data and the read reply command Into the data 
payload of an IB packet. 
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The HCA places the LID of the requesting TCA into the return IB packet 
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